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DESCRIPTION 

METHODS OF USE OF IPMP DATA FOR MPEG-n IPMP (INTELLECTUAL 
PROPERTY MANAGEMENT AND PROTECTION) 

5 

BACKGROUND OF THE INVENTION 
FIELD OF THE INVENTION 

The present invention relates to content distribution and protection, 
especially to sudi applications where the protected content based on MPEG-n is 
10 consumed by different IPMP terminals, and the same content is protected by 
different IPMP tools. 

DESCRIPTION OF THE BACKGROUND ART 

Content distribution is becoming more and more demanding as 

15 multimedia data and contents can reach anywhere and anytime. Users are 
happy with the convenience and flexibility, and they can enjoy entertainment 
easily and efficiently. On the other hand, content owners are worried about the 
illegal usage of their property. There is a balance t)etween two sides. 

There are a lot of protection techniques for protecting the content, such 

20 as data encryption, watermarking, etc. They have been implemented in many 
content distribution applications. It seems different system employs different 
kinds of mechanisms and protection techniques to distribute content with 
protection. All the terminals or content consuming devices in that case are only 
able to play and consume the content that is provided by the same content 

25 provider. They cannot exchange their tenninal or device to playback different 



wo 03/091863 



PCT/JP03/05248 



contents. 

In MPEG-n context, a standardisation group has been working on 
MPEG-2,4,7,21 IPMP. The solution is able to achieve both of the following: 

1 . Allow the same protected content to be consumed on different vendors' 
5 MPEG-n IPMP Terminals. This will be fully enabled; and 

2. Allow the same content to be protected by different vendors' IPMP Tools. 
This will be assisted to as large extent as possible. 

The prior art of MPEG-n IPMP is illustrated in Fig. 1. 
To achieve such a wide interoperability, IPMP data needs to be 
10 standardized. IPMP data is the data that describes IPMP infomnation, it may 
include time variant key that is carried in IPMP stream, it may also include tool 
initialisation information, or any data that an IPMP tool needs. However, so far, 
the standard of MPEG-2, 4. 7. 21 IPMP has not addressed this issue. 

Without the standardization of IPMP data, a IPMP tool from Vendor A will 
15 not understand the IPMP data constructed by Content Author B, hence the 
inter-operability will not be achieved, that is, the same protected content will not 
be able to be consumed on different vendor's MPEG-n IPMP terminals. 

SUMMARY OF THE INVENTION 
20 To solve the problem, to assure a clear and interoperable standard, the 

IPMP_Data_BaseClass is defined, several IPMP data extending firom this base 
class are also defined, which include IPMP opaque data, audio watermarking 
tool initialisation information, video watermarking tool initialisation information, 
IPMP key stream, etc. 

25 In a first aspect of the invention, a method of using IPMP Data in MPEG- 
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2 IPMP system, at the content author side comprises the following steps of: 

Constructing IPMP data extending from IPMP_Data_BaseClass. 

following the defined IPMP data syntax; 

Carry the IPMP data in IPMP Descriptor in IPMP Control Graph 

5 which is subsequently canied in PSI. 

In a second aspect of the invention, a method of using IPMP Data in 
MPEG-2 IPMP system, at the content author side comprises the following steps 
of: 

Constructing IPMP data extending from IPMP_Data_BaseClass. 
1 0 following the defined IPMP data syntax; 

Carry the IPMP data in IPMP Stream, the IPMP data is wrapped in 
Stream Data Update which has a destination address indicating which tool the 
IPMP data should be sent to. 

In a third aspect of the invention, a method of using IPMP Data in MPEG- 
1 5 2 IPMP system, at the IPMP terminal side, comprises the following steps of: 

The IPMP terminal extracts the IPMP Descriptor containing the IPMP 

data from the content stream; 

The IPMP terminal delivers the IPMP Descriptor containing the IPMP 
data to the specific tool which is also indicated in IPMP Descriptor by the means 

20 of IPMP Tool ID; 

The IPMP tool, upon receiving of such a IPMP Data, interprets it 

according to the specific IPMP data syntax, and act upon it. 

In a fourth aspect of the invention, a method of using IPMP Data in 
MPEG-2 IPMP system, at the IPMP terminal side is proviede. The method 
25 comprises the following steps of: 



wo 03/091863 



PCT/JP03/0S248 



The IPMP terminal demultiplexes the IPMP Stream containing the IPMP 
data from the content stream; 

The IPMP terminal delivers each IPMP^StreamDataUpdate containing 
the IPMP data to the specific tool whose address is indicated in the above 
5 mentioned IPMP_StreamDataUpdate: 

The IPMP tool, upon receiving of such an IPMP Data, interprets it 
according to the specific IPMP data syntax, and act upon it. 

In a fifth aspect of the invention, a method of using IPMP Data in MPEG- 
4 IPMP system, at the content author side comprises the following steps of: 
10 Constructing IPMP data extending from IPMP_Data_BaseClass, 

following the defined IPMP data syntax; 

Carry the IPMP data in IPMP_Tool_Descriptor in OD stream. 
In a sixth aspect of the invention, a method of using IPMP Data in 
MPEG-4 IPMP system, at the content author side, comprises the following 
15 steps of: 

Constructing IPMP data extending from IPMP_Data_BaseClass. 
following the defined IPMP data syntax; 

Cany the IPMP data in IPMPJnitialize v^rhich is subsequently carried in 
IPMP_Tool_Descriptor in OD stream. 
20 In a seventh aspect of the invention, a method of using IPMP Data in 

MPEG-4 IPMP system, at the content author side, comprises the following 
steps of: 

Constructing IPMP data extending from IPMP_Data_BaseClass. 
following the defined IPMP data syntax; 
25 Carry the IPMP data in IPMP Stream, the IPMP data is wrapped in 
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IPMP_StreamDataUpdate which has a destination address indicating which tool 
the IPMP data should be sent to. 

In an eighth aspect of the invention, a method of using IPMP Data in 
MPEG-4 IPMP system, at the IPMP terminal side, comprises the following steps 
5 of: 

The IPMP terminal extracts the IPMP_TooLDescriptor containing the 
IPMP data from the content stream; 

The IPMP terminal delivers the IPMP_TooLDescriptor containing the 
IPMP data to the specific tool which is also indicated in IPMP_Tool_Descriptor 
10 by the means of IPMP Tool ID in IPMP^TooLDescriptor; 

The IPMP tool, upon receiving of such a IPMP Data, interprets it 
according to the specific IPMP data syntax, and act upon it. 

In a ninth aspect of the invention, a method of using IPMP Data in 
MPEG-4 IPMP system, at the IPMP terminal side, comprises the following steps 
15 of: 

The IPMP terminal extracts the IPMPJnitialize containing the IPMP data 
from the IPMP_TooLDescriptor from the content stream; 

The IPMP terminal delivers the IPMP_TooLDescriptor containing the 
above mentioned IPMPJnitialize which subsequently carries IPMP data to the 
20 specific tool which is also indicated by the means of IPMP Tool ID in 
IPMP_Tool_Descriptor; 

The IPMP tool, upon receiving of such an IPMP Data, interprets it 
according to the specific IPMP data syntax, and act upon it. 

In a tenth aspect of the invention, a method of using IPMP Data in 
25 MPEG-4 IPMP system, at the IPMP terminal side, comprises the following steps 
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Of: 

The IPMP terminal extracts the IPMP_StreamDataUpdate containing the 
IPMP data from the IPMP Stream from the content stream; 

The IPMP terminal delivers the IPMP.StreamDataUpdate containing the 
5 above mentioned IPMP data to the specific tool which is also indicated in 
IPMP_StreamDataUpdate by the means of IPMP_ToolDescriptorlD; 

The IPMP tool, upon receiving of such an IPMP Data, interprets it 
according to the specific IPMP data syntax, and act upon it. 

In an eleventh aspect of the invention, a method of using IPMP Data in 
10 MPEG-n IPMP system, at the content author side, comprises the following 
steps of: 

Constructing IPMP data extending from some IPMP data base class, 
following the defined IPMP data syntax; 

Carry the IPMP data in defined position in the MPE6-n IPMP content 
15 stream; 

In a twelfth aspect of the invention, a method of using IPMP Data in 
MPEG-n IPMP system, at the IPMP terminal side, comprises the following steps 
of: 

The IPMP terminal extracts the IPMP Data from the defined position in 
20 the content stream; 

The IPMP terminal delivers the IPMP Data to the specific tool which is 
also indicated by the means of IPMP Tool ID associated with the IPMP Data; 

The IPMP tool, upon receiving of such an IPMP Data, interprets it 
according to the specific IPMP data syntax, and act upon it. 
25 In a thirteenth aspect of the invention, a Method of using IPMP video 



wo 03/091863 PCT/JP03/05248 

7 

watermarking tool in MPEG-n IPMP system, at the IPMP terminal side, 

comprises the following steps of: 

The IPMP terminal extracts the IPMP video watermarking initialization 

data from the defined position in the content stream; 
5 The IPMP terminal delivers the IPMP video watermarking initialization 

data to the specific video watermarking tool which is also indicated by the 

means of IPMP Tool ID associated with the IPMP Data; 

The IPMP video watermarking tool, upon receiving of such an IPMP Data, 

interprets it according to the specific IPMP data syntax, and act upon it; 
10 The IPMP video watermarking tool, when detecting a watermark from the 

video stream, notifies the terminal using IPMP.SendVideoWatermark message. 

BRIEF DESCRIPTION OF THE DRAWINGS 

This and other objects and features of the present invention will become 
15 clear from the subsequent description of a preferred embodiment thereof made 
with reference to the accompanying drawings, in which like parts are designated 
by like reference numerals and in which: 

Fig. 1 is a diagram showing IPMP architecture for generic IPMP as the 
prior art; 

20 Fig. 2 is a diagram showing the types of IPMP data extending from 

IPMP_DataBase; 

Fig. 3 is a diagram showing the places to carry IPMP data in MPEG-2 
IPMP content; and 

Fig. 4 is a diagram showing how MPEG-2 IPMP terminal processes 
25 IPMP protected MPEG-2 content using IPMP data. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Fig. 2 illustrates the defined IPMP data extending from 
IPMP_Data_BaseClass. Places where IPMP data extending from 
5 IPMP_Data_BaseClass are also specified. 

IPMP_DataBase defined as IPMP_Data_BaseClass includes information 
for using IPMP tool(s). The information is necessary to detect digital 
wartermarks and to decode content. Such information is managed in register of 
the IPMP system and is retrieved when processing the content. 
10 IPMP_Data_BaseClass is described in predetermined syntax as shown 

in "Syntax" of "IPMP_Data_BaseClass" below. In order to achieve a 

flexible and interoperable IPMP system structure for MPEG-n and other 
applications as described above, we should be able to allow the followings. 
1 . Fix the syntax of various commonly used IPMP data, that includes: 
15 a. IPMP opaque data; 

b. IPMP decryption configuration data; 

c. IPMP audio watermarking configuration data; 

d. IPMP video watermarking configuration data; and 

e. IPMP key stream. 

20 2. Fix the position of where the IPMP data should be carried in the MPEG-n 
content which is protected by IPMP. 

Only when all above are fixed, the interoperable IPMP system for MPEG- 
n can be fully achieved. 

Detailed explanations on items a to e will be described later. 
25 Fig. 3 illustrates the places to carry IPMP data in MPEG-2 IPMP conent. 
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3.1 is the place in IPMP stream, where IPMP data can be carried in 
IPMPJnfo_message which will then form the IPMP elementary stream. 
IPMP_KeyData can be carried in this place. 3.2 is the place in IPMP Descriptor 
which is subsequently canried in IPMP Control Graph Descriptor in PSI., tool 
initialisation data can be carried in this place. 

IPMP Data is carried in the IPMP protected content bitstream (MPEG-2, 
4, 7, 21). The base class is defined as IPMP_Data_BaseClass. 

IPMP data that are all extended from IPMP_Data_BaseClass include: 

the IPMP_AudioWatermarkinglnit; 

IPMP_SelectiveDecryptionMessage; 

IPMP_VideoWatermarkinglnit; 

IPMP_KeyData; and 

IPMP_OpaqueData. 

IPMP_Data_BaseClass 
Syntax 

Aligned(8) expandable(2»-i)class IPMP_Data_BaseClass{ 
bit(8) Version; 
bit(8) IPMP_DataTag; 

} 

Semantics 

Version indicates the version of syntax used in the IPMP Data and shall 
be set to 0x01 . 

IPMP_DataTag indicates the tag for the extended IPMP data. The exact 
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values for the extension tags are defined in the following table. 



Table 1- Tags for messages extending iPMP_ToolMessageBase 



8-bit Tag Value 


Symbolic Name 


0x00 


Forbidden 


0x01 


IPMP_OpaqueData tag 


0x02 


IPMP SelectiveDecryptionMessage tag 


0x03 


IPMP_AudioWatermarkinglnit tag 


0x04 


IPMP^VideoWatermarkinglnit tag 


0x05 


IPMP_KeyData Jag 
<-> IPMP RightsData tag 


0x06 - OxCF 


ISO Reserved 


OxDO-OxFE 


User Defined 


OxFF 


Forbidden 



Places to carry IPMP Data extended from IPMP_Data_BaseClass 
5 IPMP Data extending from IPMP_Data_BaseClass could be carried in 

the following two places: 

- IPMP_Descriptor class (MPEG-2 system) 

- IPMPJnfo_message class which is subsequently carried in IPMP Stream. 
(MPEG-2 system) 

10 - IPMP_Tool_Descriptor class (MPEG-4 system) 

- IPMP_lnitialize which is subsequently carried in IPMP_Tool_Descriptor 
class (MPEG-4 system) 

- IPMP_StreamDataUpdate v^ich is subsequently carried in IPMP Stream. 
(MPEG-4 system). 

15 In MPEG-2 system case, the IPMP_Descriptor and IPMPJnfo__message 

need modifications as below: 



wo 03/091863 



PCT/JP03/05248 



IPMP_Descriptor 

The new syntax for this should be: 



Table 2 - IPMP Descriptor 


Syntax No. of bits 


Mnemonic 


0 


IPMP.descriptort) { 








descriptor_tag 


8 


Ulmsbf 




descriptoMength 


8 


Uimsbf 




IPMP DescriptoriD 


8 


Ulmsbf 




IPMP_ToollD 


128 


Uimsbf 




numControlPoints 


8 


ulmsbf 




for ( i=0: i<numControlPoints; 






i++){ 










controlPoint 


8 


ulmsbf 




sequenceCode 


8 


uimsbf 




IPMP Data length 


16 


ulmsbf 




for ( i=0; i< N; 












IPMP Data 


> 


} 


} 







where the IPMP_Data is the IPMP Data extended from IPMP_Data_BaseClass. 



5 IPMP_StreamDataUpdate 

The IPMP Stream should be a concatenation of IPMP Stream Data 
Update, with the new syntax defined below. 
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Table 3 IPMP.StreamDataUpdate 



Syntax 


No. of bits 


Mnemon 
ic 


IPMPJnfo_message() { 

IPMP_descriptorJd 
controljK>int 
length of message 
IPMP.DataJength 
for ( i=0; i<N; i++) { 
iPMP data 

} 

> 


8 
8 
16 
16 

8 


uimsbf 
uimsbf 
uimsbf 
uimsbf 

uimsbf 



where the IPMP_Data is the IPMP Data extended from IPMP_Data_BaseClass. 

iPMP_StreamDataUpdate has a destination address indicating >A^ich tool 
the IPMP data should be sent to. 

Types of IPMP Data that extends from IPMP_Data_BaseClass 
Opaque Data 

Opaque Data can contain various infromation depending on respective 
users, cases and so on. 

There are many cases where opaque data may be needed for certain 
tools. Hence IPMP_OpaqueData_tag = 0x01 is reserved for carriage of opaque 
data. The syntax is illustrated below. 

class IPMP_OpaqueData extends IPMP_Data_BaseClass 
: bit(8) tag = IPMP_OpaqueDataJag 
15 { 

ByteArray opaqueData; 

} 



5 



10 
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Selective Decryption Configuration Message 

Selective Decryption Configuration Message specifies portions in the 
IPMP Stream.where the stream is encrypted. 
5 The class IPMP_SelectiveDecryptionMessage should now be extended 

from IPMP_Data_BaseClass instead of IPMP_ToolMessageBase. The tag for 
this class should be IPMP_SelectiveDecryptionMessage_Tag as defined in the 
above table for IPMP_Data_BaseClass tags. 

1 0 Audio Watermarking Configuration Message 

Audio Watermarking Configuration Message specifies an initial value to 
detect watermarks added on an audio stream. 

The class IPMP_AudioWatermarkinglnit should now be extended from 
IPMP_Data_BaseClass instead of IPMP_foolMessageBase. The tag for this 
15 class should be IPMP_AudioWatermarkinglnit_Tag as defined in the above 
table for IPMP_Data_BaseClass tags. 

See "MPEG -2 IPMP", ISO/IEC 13818-1:2000 PDAM2. March. 2002. 
and "MPEG -4 IPMP Extension". FPDAM ISO/IEC 14496-1:2001 / AMDS, 
20 March, 2002. 

IPMP Key Data 

The IPMP_KeyData is defined to extend from IPMP_Data_BaseClass. 
This IPMP data could possibly be carried in IPMPJnfo_message which is 
25 subsequently carried in IPMP Stream. This facilitates the time variant key 
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carried in IPMP Stream. 
Syntax 

class IPMP_KeyData extends IPIVIP_Data_BaseClass : 
5 bit(8) tag = IPMP^KeyDataJag 

{ 

ByteArray keyBody; 
bit(1) isTimeScheduled; 
const bit(7) reserved = ObOOOOOO; 
10 if (isTimeScheduled) 

{ 

bit(33) PTS; 

const bit(7) reserved = ObOOOOOO; 

} 

15 ByteArray OpaqueData; 

} 

Semantics 

keyBody - the body of the key. The value shall be data that conforms to 
20 a rule for data structure of the key defined outside of this document. 

IsTimeScheduled - Specify if the key is scheduled to be active at a 
certain PTS value. If this value is set to 1, there should be a PTS value followed 
indicating the activation time. 

OpaqueData - Any other opaque data carried in this IPMP data. 



25 
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Video Watermarking Configuration Message 

Video Watermarking Configuration IVIessage specifies an initial value to 
detect watermarks added on a video stream. IPMP^VideoWatermarkinglnit 
data is used to intialise a Watermarking Tool about the process of 
5 insertion/extraction of the watermarking payload into/From a video stream. 



Syntax 

class IPMP_VideoWatermarkinglnit extends IPMP_Data_BaseClass : 
bit(8) tag = IPMP_VideoWatermarkinglnitJag 

10 { 

bit(8) inputFormat; 
bit(4) requiredOp; 
bit(1) hasOpaqueData; 
const bit(3) reserved = ObOOO; 

15 

if (inputFormat == YUV) 
{ 

bit(16) frame_horizontal_size; 
bit(16) frame_verticaLsize; 
20 bit(8) chroma_format; 

} 



25 



if ((requiredOp == INSERT_WM)||(requiredOp == REMARK_WM)) 
{ 

bit(16) wmPayloadLen; 
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bit(8) wmPayload[wmPayloadLen]; 

} 

if ((requiredOp == EXTRACT_WM)) 
5 { 

bit(16) wmRecipientId; 

} 

if (hasOpaqueData) 
10 { 

bit(16) opaqueDataSize; 

bit(8) opaqueData[opaqueDataSize]; 

} 

} 

15 

Semantics 

The IPMP_videoWatemnarkinglnit data delivers to a watermarking tool all 
the information about the characteristics of the video content, the type of action 
to be performed on it and, possibly other related proprietary data required by 
20 the watermarking tool. Furthermore in case of: 

- insertion, the watermarking payload to be inserted; 

- extraction, the ID of the recipient of the watermarking payload is 
provided; 

- remarking, the watermarking payload to be inserted. 
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• inputFormat: The format of the video input stream, as indicated in a 
Table to be maintained by a registration authority. The Table shall contain at 
least ail video formats indicated in Table 8 "ObjectTypelndication values" in [3] 

• RequiredOp: The operation that the watermarking tool is required to 
5 perform on the audio stream. The following values are allowed: INSERT_WM = 

0EXTRACT_WM=1REMARK_WM =2ISO reserved = 3..10User defined = 
11..15 

- frame_horlzontaLsize: Horizontal size of the yuv frame 

• frame_verticaLsize: vertical size of the yuv frame 

10 • chroma_format: chroma_format: 0x01=4:2:0, 0x02=4:2:2, 0x03=4:4:4, 

ISO reserved =0x04.. OxAO, User defined = OxAL.OxFE, Forbidden: 0x00, OxFF 

• WmPayloadLen: the length of the watermarking payload in bytes to 
be inserted in the video content. 

- WmPayload: the watermarking payload to be inserted in the video 
15 content 

• WmRecipientId: the address of the destination tool, to which the 
watermarking payload and compression Information must be delivered. 

- HasOpaqueData: a flag that indicates if the message also carries 
opaque data information for the watermarking tool. 

20 • OpaqueDataSize: the length of the opaque data field in bytes 

• OpaqueData: the opaque data field carrying proprietary 
information to the watermarking tool (e.g. initialisation parameters, like specific 
algorithm id, keys, etc. ) 

25 IPMP_SendVideoWatermark Message 
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The Watermarking Tool receives the video stream and in case of 
watermarking extraction, replies with an IPMP_SendVideoWatermark message 
carrying the watermarking payload. 

Syntax 

class IPMP_SendVideoWatermark extends IPMP_ToolMessageBase : 
bit(8) tag = IPMP_SendVideoWatennark_tag 

{ 

bit(4) wm_status; 
bit(1 ) hasOpaqueData; 
bit(3) reserved = ObOOO; 
if (wm_status == WM_PAYLOAD) 
{ 

ByteArray payload; 

} 

if (hasOpaqueData) 
{ 

ByteArray opaqueData; 

} 

} 

Semantics 

A watermarking tool, vtrhich has been required to perform payload 
extraction by means of an IPMP_VideoWatermarkinglnit will send this message 
25 to wmRecipientId each time a new watermarking payload is extracted from the 



10 



15 



20 
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videocontent. 

• wm_status: the result of the check if watermarking was present. 
If watermark was detected, then this value also says if the payload extracted is 

5 carried inside the message or not. Possible values are listed in the wm_status 
table below. 

- hasOpaqueData: a flag indicating whether this message carries 

opaque data. 

• payload: the watermarking payload extracted from the video 
10 content. 

• opaqueData: opaque data firom the Watermarking Tool. 
wm_status table 

• WM_PAYLOAD: Watermarking was present in the video stream, 
15 payload is carried in the message. 

• WM_NOPAYLOAD: Watermarking was present in the video stream, no 
payload is carried in the message. 

• NO_WM: Watermarking was not present in the video stream. 
•WM_UNKNOWN: The Watemnarking Tool was unable to detect 

20 whether watermarking was present in the video stream or not. 

Refering now to Fig. 3, adaptation of the information contained in 
IPMP_DataBase is described next. Fig. 3 shows flows of information in a 
server which provides a terminal with a IPMP protected content. In this Figure, 
25 Program Specific Information ("PSI") and "IPMP Protected MPEG-2 Content" 
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are finally obtained and provided for the terminal. PSI describes, for example, 
one or more types of scrambling scheme and existence of wartermarks. One 
PSI may be created for each content, or for a plurality of content. 

IPMP_OpaqueData is set in IPMP Control Information in PSI. 
5 The three types of information ** IPMP_SelectiveDecryptionMessage", 

"IPMP_AudioWatermarkinglnit", and "lPMP_VideoWatermarkinglnit" are defined 
in IPMPJnfo, where IPMP data is carried. The above three types of information 
are incorporated in IPMP_ControLGraph and then set in Program Map Table 
(PMT). 

10 "IPMP_KeyData" forms a part of IPMP information, which contains data 

on one or more keys for descrambling the content. "IPMP_KeyData" may be 
varied dependent on time. A headeer is added to IPMP information to be 
incorporated in "IPMP Stream" in the Content Stream, where IPMP data is 
carried. 

15 Based on the IPMP_Data_BaseCIass, some useful IPMP data syntax 

were clearty defined. Suppose the content's video stream is encrypted by IPMP 
AES tool A, the content author can cleariy define an AES tool initialisation 
information using IPMP_SelectiveDecryptionMessage extending from 
IPMP_Data_BaseClass. The initialization information may include block size, 

20 encryption method. The entire IPMP_SelectiveDecryptionMessage can be 
carried in IPMP Descriptor (in MPEG-2 IPMP case) or IPMP_TooLDescriptor 
(in MPEG-4 IPMP case), as illustrated by 4.1 in Fig. 4. 

The video stream may be encrypted by a time variant key stream, in this 
case, the content author constructs IPMP_KeyData extending from 

25 IPMP_Data_BaseCiass which includes the time variant key. The 
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IPMP_KeyData is carried in IPMP Stream, as illustrated by 4.2 in Fig. 4. 

The AES tool vendor can then conform to the same standard, and 
develop a AES Decryption tool A (as illustrated in Fig. 4) that can understand 
the IPMP_SelectiveDecryptionMessage coming from IPMP_Descriptor or 

5 IPMP_Tool_Descriptor in the content stream. 

Suppose the content's video stream is watermari^ed by IPMP Video 
Watermarking tool B, the content author can clearly define a video 
watermarking tool initialisation information using IPMP_VideoWatermarkinglnit 
extending from IPMP_Data_BaseClass. The initialization Information may 

10 include chroma fonnat. frame size, watermark payload to be inserted, whether 
to insert or extract watennari<, etc. The entire IPMP_VideoWatermarkinglnit can 
be carried in IPMP Descriptor (in MPEG-2 IPMP case) or 
IPMP_Tool_Descriptor (in MPEG-4 IPMP case), as illustrated by 4.3 in Fig. 4. 
The video watermarking tool vendor can then conform to the same 

15 standard, and develop a video watermark tool B (as illustrated in Fig. 4) that can 
understand the IPMP_VideoWatermari<inglnit coming from IPMP_Descriptor or 
IPMP_Tool_Descriptor in the content sfream. 

At the terminal side, when the terminal receives the content stream, it 
retrieves the IPMP Descriptor from IPMP Control Graph in MPEG-2's PSI. The 

20 IPMP Descriptor containing the IPMP_SelectiveDecryptionMessage is 
delievered to the AES decryption tool A as illustrated by 4.4 in Fig. 4. AES 
decryption tool receives this IPMP data, parses it according to the defined 
syntax, and configures itself. 

The IPMP Descriptor containing the IPMP_VideoWatermarkinglnit is 

25 delievered to the video watermarking tool B as illustrated by 4.5 in Fig. 4. Video 



wo 03/091863 



PCT/JP03/05248 



22 

watermarking tool B receives this IPMP data, parses it according to the defined 
syntax, and configures itself. 

When the content flows it, the MPEG-2 terminars demultiplexer retrieves 
IPMP data which contains the time variant key from IPMP stream. It delivers 
5 this IPMP Data to AES decryption tool A as illustrated by 4.6 in Fig. 4. Tool A 
receives this IPMP_KeyData, and uses the new time variant key to decrypt the 
video elementary stream. 

The video watermarking tool receives the video stream and in case of 
watermarking extraction, replies with an IPMP_SendVideoWatermark message 
10 carrying the watermarking payload as illustrated by 4.7 in Fig. 4. 

With the above mentioned embodiment, by constructing a data base 
which contains information to be used to inform the MPEG-2 IPMP terminal 
what kind of content protection tool is used, what kind of watermarking tool is 
used, or what kind of encryption key is used, the interoperability between the 
15 protected-content provided and this receiver can be realized and any MPEG-n 
IPMP terminal can decrypt the contents sent from a content provider together 
with the IPMP stream or IPMP control information or IPMP control graph. 



wo 03/091863 



23 



PCT/JP03/05248 



CLAIMS 

1 . A method of using IPMP Data in IPMP system, at the content author side, 
comprising: 

5 Constructing a database which contains information to be used for iPMP 

tool required to process and protect content; 

Creating an IPMP data from the information contained in the database; 
Adding the IPMP data to the content to creat IPMP Protected content. 

2. The Method of using IPMP Data in IPMP system according to claim 1, at 
1 0 the content author side, 

wherein the IPMP data is constructed by extracting information from the 
database based on a defined IPMP data syntax. 

3. The Method of using IPMP Data in IPMP system according to claim 2, at 
the content author side, further comprising canrying the IPMP data in IPMP 

1 5 Descriptor in IPMP Control Graph, which is subsequently carried in PSI. 

4. The Method of using IPMP Data in IPMP system according to claim 2, at 
the content author side, wherein the IPMP data is wrapped in 
IPMP_StreamDataUpdate which has a destination address indicating which tool 
the IPMP data should be sent to. 

20 5. The Method of using IPMP Data in IPMP system according to claim 1 , 
wherein the IPMP Protected content is MPEG-2 content. 
6. The Method of using IPMP Data in IPMP system according to claim 2, 
wherein the IPMP Protected content is MPEG-4 content, and 
wherein the method further comprises Carrying the IPMP data in 
25 IPMP_Tool_Descriptor in OD stream. 
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7. The Method of using IPMP Data in IPMP system according to claim 2, 
wherein the IPMP Protected content is MPEG-4 content, and 

wherein the method further comprises Carrying the IPMP data in 
IPMPJnitialize which is subsequently carried in IPMP_Tool_Descriptor in OD 
5 stream. 

8. The Method of using IPMP Data in IPMP system according to claim 2, 
wherein the IPMP Protected content is MPEG-4 content, and 

wherein the method further comprises Carrying the iPMP data in IPMP 
Stream, which is wrapped in IPMP_StreamDataUpdate which has a destination 
10 address indicating which tool the IPMP data should be sent to. 

9. The Method of using IPMP Data in IPMP system according to claim 2, 
wherein the IPMP Protected content is MPEG-n content, and 

wherein the method further comprises Carrying the IPMP data in defined 
position in the MPEG-n IPMP content stream. 
15 10. A Method of using IPMP Data in IPMP system, at the IPMP terminal side, 
comprising: 

Extracting IPMP Descriptor containing IPMP data from IPMP Protected 
content; and 

Delivering IPMP Descriptor containing the IPMP data to a IPMP tool 
20 which is also indicated in IPMP Descriptor by the means of IPMP Tool ID, 

wherein the IPMP tool, upon receiving of such a IPMP Data, interprets it 
according to the specific IPMP data syntax, and act upon it. 
11 . A Method of using IPMP Data in IPMP system, at the IPMP terminal side, 
according to claim 10. further comprising: 
25 Demultiplexing the IPMP Stream containing the IPMP data from the 
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IPMP Protected content; and 

Delivering each IPMP_StreamDataUpdate containing the IPMP data to 
the IPMP tool whose address is indicated in the above mentioned 
IPMP_StreamDataUpdate. 
5 wherein the IPMP tool, upon receiving of such an IPMP Data, interprets it 

according to the specific IPMP data syntax, and act upon it. 

12. A Method of using IPMP Data in IPMP system, at the IPMP terminal side, 
according to claim 10, wherein the IPMP Protected content is MPEG-2 content. 

13. A Method of using IPMP Data in IPMP system, at the IPMP terminal side, 
1 0 according to claim 1 2, further comprising: 

Extracts the IPMPJTooLDescriptor containing the IPMP data from the 
IPMP Protected content; and 

Delivering the IPMP_TooLDescriptor containing the IPMP data to the 
IPMP tool which is also indicated in IPMP_TooLDescriptor by the means of 
15 IPMP Tool ID in IPMP_TooLDescriptor, 

wherein the IPMP tool, upon receiving of such a IPMP Data, interprets it 
according to the specific IPMP data syntax, and act upon it. 

14. A Method of using IPMP Data in IPMP system, at the IPMP terminal side, 
according to claim 10, 

20 wherein the IPMP Protected content is MPEG-4 content, 

wherein the method further comprises: 

Extracts the IPMPJnitialize containing the IPMP data from the 
IPMP_TooLDescriptor from the IPMP Protected content; 

Delivering the IPMP_TooLDescriptor containing the above mentioned 
25 IPMPJnitialize which subsequently carries IPMP data to the IPMP tool which is 
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also indicated by the means of IPMP Tool ID in IPMP_Tool_Descriptor, 

wherein the IPMP tool, upon receiving of such an IPMP Data, Interprets it 

according to the specific IPMP data syntax, and act upon it. 

15. A Method of using IPMP Data in IPMP system, at the IPMP terminal side, 
5 according to claim 10, 

wherein the IPMP Protected content is MPEG-4 content, 
wherein the method further comprises: 

Extracts the IPMP_StreamDataUpdate containing the IPMP data from the 
IPMP Stream from the IPMP Protected content; 
10 Delivering the IPMP_StreamDataUpdate containing the above mentioned 

IPMP data to the specific tool which is also indicated in 
IPMP_StreamDataUpdate by the means of IPMP_ToolDescriptorlD, and 

wherein the IPMP tool, upon receiving of such an IPMP Data, Interprets it 
according to the specific IPMP data syntax, and act upon it. 
15 16. A Method of using IPMP Data in IPMP system, at the IPMP terminal side, 
according to claim 10, 

wherein the IPMP Protected content is MPEG-n content, 

wherein the method further comprises: 

Extracting the IPMP Data from the defined position in the IPMP Protected 
20 content; and 

Delivering the IPMP Data to the IPMP tool which is also indicated by the 
means of IPMP Tool ID associated with the IPMP Data, 

wherein the IPMP tool, upon receiving of such an IPMP Data, interprets it 
according to the specific IPMP data syntax, and act upon it. 
25 17. A Method of using IPMP Data in IPMP system, at the IPMP terminal side, 
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according to claim 10, 

wherein the IPMP Protected content is MPEG-n content, 
wherein the method further comprises: 

Extracting the IPMP video watermarking initialization data from the 
defined position in the IPMP Protected content; and 

Delivering the IPMP video watermarking initialization data to the specific 
video watermarking tool which is also indicated by the means of IPMP Tool ID 
associated with the IPMP Data, 

wherein the IPMP video watermarking tool, upon receiving of such an 
IPMP Data, interprets it according to the specific IPMP data syntax, and act 
upon it, and 

wherein the IPMP video watermarking tool, when detecting a watermark 
from the video stream, notifies the terminal using IPMP_SendVideoWatermark 
message. 
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